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SUMMARY 


The purpose of this report is to present a least squares procedure 
for calculating smoothing and differentiation coefficients and to present 
a procedure for calculating standard deviations of the data on which 
smoothing and differentiation formulas are used. 


SECTION I. INTRODUCTION 


External and onboard observations of various types are used in 
evaluating the performance of a flight test vehicle. All of these obser- 
vations contain random errors as well as bias and systematic errors. 
Often first and second derivatives of the observations with respect to 
time are required. The presence of random error in the observations 
makes the determination of plausible derivatives considerably more 
difficult. Most observations fall into two categories: 1) essentially 

time varying functions {such as external tracking data, guidance output, 
pressures, flow :-ates, etc.) and 2) essentially oscillatory functions 
(such as normal accelerations, angular accelerations, angular rates, 
etc.). Appropriate smoothing and differentiation procedures can 
largely reduce the effect of random errors in the observations. 

The derivation of coefficients that may be used for smoothing and 
differentiation of various observations is laborious, especially if a 
large number of joints and a high degree approximating polynomial are 
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required. In addition, it is usually impractical to publish a sufficient 
variety of smoothing and differentiation coefficients to meet all needs 
since the major characteristics of the specific observation type should 
be considered. Most methods for computing smoothing and differentia- 
tion coefficients (Refs. 1, 2, and 3) derive them separately and with a 
lesser degree of flexibility than is desirable for evaluation purposes. 

This report presents the development of a compact method for 
determining smoothing and differentiation coefficients that is easily 
adaptable to the characteristics of the observations and is readily 
usable on high speed electronic digital computers. The method 
presented is very effective with observations that can be approximated 
by a polynomial that is some function of an independent variable. The 
method can also be used with observations that are essentially periodic 
functions provided that only short arcs of a cycle occur during a given 
smoothing or differentiation span. 

The methods were developed specifically for flight evaluation 
purposes but are equally valid for any type of observation or data for 
which smoothing or differentiation techniques are useful. 


SECTION II. SMOOTHING AND DIFFERENTIATION 
COEFFICIENTS 

A. PROCEDURE FOR CALCULATING THE COEFFICIENTS 

One basic assumption is needed in the development of the 
proposed method of determining the smoothing and differentiation 
coefficients. The assumption is: The observation can be sufficiently 

well represented as a polynomial that is a function of an independent 
variable over a short span of the independent variable . Most observa- 
tions used in flight evaluation would use the time of flight as the 
independent variable. The basic equation is obtained by expanding the 
function, X t , in a Taylor's series about the point, t 0 . 

X t = X 0 + + Lt z X 0 +i.£t 3 X 0 + . . . + x 0 (1) 

c b d ! 

where X^- is an observable parameter at time t; At is the time difference 
between the time of an observable parameter and the time at which the 
smoothed or differentiated value is to be calculated, i.e. , At = t - t 0 ; 
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_ _ — d 

X 0 is the smoothed parameter at to; X 0> X 0 , ... X 0 are the successive 
derivatives of the smoothed parameter at t 0 . Truncating equation (1) 
after the d^ 1 term determines the degree of the polynomial representing 
the observation. The point of truncation should be chosen such that 
bias induced by using a polynomial having its d^ 1 derivative constant 
is insignificant compared to random error remaining in the smoothed 
data. 

The use of Eq. (1) will be illustrated in the following simple 
example which assumes the second derivative constant and which 
involves three observed values. The observed values can be expressed 

as: _ 

X. x = X 0 +4t-iX 0 + l^t-i 2 X 0 

X 0 = X 0 + (0)X 0 + (0)f 0 (2) 

Xj = X 0 + Atj ±0 + I Atj 2 X o 

This may be expiessed in matrix form as: 



In this example, the smoothing polynomial will fit the observed 
points exactly. Consequently, there can be no removal of random 
error. By using more observations without increasing the degree of 
the smoothing polynomial, a least squares procedure results. With the 
additional observations Eq. (3) becomes: 

R = EU (4) 


where for example: 
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The elements of the matrix E _are the partial derivatives with respect 
to the unknowns Xq , Xq , and X 0 of the conditional equations: 

Fi = X 0 + Ati t 0 + I - X t . 

where i = 0, 1, N - 1 . 

The least square solution of Eq. (4) is now given by the 
expression: 

[(E T WE)- 1 (E T W)] R = U (5) 

where W is an arbitrary weight matrix. 

The smoothing and differentiation coefficients are now the 
elements of the matrix J(E^ WE)* 1 (E^W)j and are entirely independent 
of the observed parameters. 

The matrix [(E^WE)" 1 (E^ W)J will contain d + 1 rows and N 
columns. The smoothing coefficients are the elements of the first row 
denoted C 0 ^, the first derivative coefficients denoted are the 
elements of the second row, the dth derivative coefficients denoted 
are the elements of the d + 1 row. Each set of coefficients forms a row 
matrix. The solutions become: 
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X 0 = C 0 d 31 
X 0 = C j d R 

^o = C 2 d R (6) 



This procedure for obtaining coefficients does not require that 
the observations he at equally spaced time intervals. There is an 
advantage, however, in having data available at equally spaced intervals 
since the coefficients need to be calculated only once. Thereafter, the 
data can be processed with a moving arc as long as the data remain 
available at the interval for which the coefficients were calculated. 

If the data points are not equally spaced then the coefficients 
must be recalcula:ed whenever a smoothed or differentiated value is 
desired. 


A number of smoothing and differentiation coefficient ratios 
(the silhouettes or shapes of the plotted coefficients versus time) are 
shown on pages 12 to 15- The dashed lines in each figure indicate 
equ^l weights wers used in the calculation of the coefficients, and the 
solid lines indicate the weights used in the calculations were of the 
form e'k* 2 , L e ., normally distributed (see Fig. 4). 

Figure 1 shows the silhouettes of the smoothing coefficients 
Co 1 , C 0 3 , and C 0 5 . The smoothing polynomials for which these coeffi- 
cients are applicable are of the degrees one, three, and five, respectively. 
Figure 2 shows the silhouettes of the first derivative coefficients , 

Ci 4 , and C x 6 . The smoothing polynomials for which these coefficients 
are applicable are of degrees two, four, and six, respectively. Figure 3 
shows the silhouettes of the second derivative coefficients C^ 3 and C 2 5 . 

The smoothing polynomials for which these coefficients are applicable 
are of degrees three and five, respectively. 

B. INTERPOLATING AND EXTRAPOLATING 

By slight y modifying the basic formulas, one may calculate 
the coefficients fo : interpolating and extrapolating. The following 
modification is made to Eq . (4) for obtaining interpolation coefficients. 
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This arrangement merely omits the to observation since this is the time 
that an interpolated value is needed. 


For extrapolation Eq. (4) becomes: 



This extrapolation method will produce the coefficients necessary to 
obtain values (X 0 , X 0 , X 0 ) at some time after the observations are 
available. The same procedure could produce coefficients for extrapo- 
lating values prior to the time that observations are available by 
substituting observations X +1 through X +7 in place of X_ x through X, 7 . 

C. APPLICATION 

The purpose of using smoothing and differentiation procedures 
is to eliminate random error from measured data and to obtain realistic 
derivatives. To obtain accurate results without inducing bias or 
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destroying real data, the degree (d) of the smoothing polynomial, the 
number (N) of observations, and the weights (W) to be used in the 
calculation of the coefficients must be properly chosen. To 
accomplish this Ihe following suggestions are made: 

1. Since the smoothed values become more sensitive to 
random error as the degree of the smoothing polynomial increases, 
the polynomial oi lowest degree which adequately represents the data 
should be used. 

2. Numerous factors must be considered in deciding the 

number of observations to be used in calculating the coefficients. Some 
of the more important are: (a) the degree of smoothing polynomial to 

be used; (b) the magnitude of the various derivatives of the smoothing 
polynomial; (c) the observation rate; (d) the amount of random error in 
the data. In other words a priori knowledge of the data is essential. 

3. All the observations in the smoothing interval should be 
used unless "stray” values have definitely been detected. 

4. If random error is unusually large, increase the number 
of coefficients or reduce the degree of the smoothing polynomial. The 
adverse effects of bias induced in this manner may be minor compared 
to the resulting effects of poor smoothing. 

5. There are no restrictions in formulating the weights to be 
assigned to the observed values. In most cases, however, the weights 
should be symmetrical about the midpoint of the smoothing interval and 
the weight of the value corresponding to the midpoint should be a 
maximum . 

All of the above suggestions are applicable for observations 
that may be either approximated by a polynomial, or are periodic 
functions with only short arcs of a cycle occurring during a given 
smoothing or differentiation span. 


SECTION III. CALCULATION OF STANDARD DEVIATIONS 


Standard deviations can be calculated easily by carrying the 
smoothing and dijferentiation coefficient calculations several steps 
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further than illustrated in Section II. These standard deviations will 
pertain to the raw data prior to any smoothing effects. 

The coefficients [(E^ WE)" 1 (E^ W)] as obtained from Eq. ( 5 ) are 
used to calculate the unknowns (U) at some particular time, t 0 . The 
standard deviations are then calculated at this particular time inde- 
pendent of the surrounding times except through the matrix (E) . 

The smoothed parameters (S) about to are obtained from the 
expression: 

S ^ EU. 


The desired residuals are now given by: 
V = R - S 
where: 



X-3 


X 

u> 


X_3 -X_3 


AX .3 

s = 

X-2 

1 

\ 

R = 

X -2 
1 

V = 

X -2 - X _2 
1 1 

1 1 

or 

AX .2 

i 

| 


I 

Xs 


1 

1 

X 3 


i l 

x 3 - x 3 


1 

AX 3 


The variance is then given by: 


ff 2 x 0 = 

where: 


y t y 

N 


Y = 


AX. 


AX 


ax. 2 - ax 


and 


AX = 


3 

X 

i = -3 


AX- 


N 


( 9 ) 


( 10 ) 


AX, - AX 


The first derivatives of the smoothed values around t 0 are obtained 
in the following manner. The first derivative of Eq. ( 1 ) is written: 
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x t = X 0 + AtX 0 +i^X 0 +iAt 3 X 0 ... (11) 

and it is seen tha*: the first derivatives of the smoothed values can easily 
be obtained with slight modifications to the matrix (E) and the matrix (U). 
Let E denote the matrix formed from the matrix (E) by dropping its last 
column and let U be the matrix formed from the matrix (U) by dropping 
its first element, then 


D = EU (12) 

The elements of the column matrix (D) are the desired derivatives. The 
residuals required for the calculation of the standard deviation of X at 
to are the differences in the derivatives of the smoothed values and the 
derivatives obtained from the unsmoothed data. The second derivatives 
of the smoothed values are obtained in a similar manner. 


The following simple example will illustrate the procedure. It is 
assumed in this example that the observed data can be represented by 
a third degree polynomial and that nine observed data points are avail- 
able. The smoothed values around to are given by: 
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1 At .4 -t At_ 4 2 
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X 0 
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*0 
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1 At 3 


% 
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1 At 4 . "T At 4 3 



The first derivatives of the smoothed values are given by: 
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1 At_4 1 At_4 2 
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. 
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and the second derivatives of the smoothed values are given by: 


X.4 


1 At _ 4 

*-3 


1 At . 3 

X 3 


1 At 3 

1 

|:X 

— -> 


1 At 4 


(14) 


(15) 


The appropriate variances are obtained in the same manner as above. 


SECTION IV. ACCURACY OF METHOD 


The matrix 


E T WE)- , (E T W)| 


which will be defined as B, is 
essentially the partial derivatives of the unknowns, U, with respect 
to the observed parameters, R. The variances of U can be determined 
from the usual equation if the variances of observed parameters are 
known. 


o-U 2 = B o- r 2 B T 


( 16 ) 
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The variances of the smoothed positions, velocity, and acceleration 
were derived from the above equation assuming the raw position data 
were known within ±10 meters as an example of the accuracy obtained 
with this procedure. The standard deviations, which are the square 
roots of the variances, for the smoothed positions, velocities, and 
accelerations are shown in Figs. 5 through 7. 

The standard deviations are plotted versus the number of points used 
where various degree polynomials were assumed to fit the data during 
the interval. Each of Figs. 5 through 7 indicates that the largest number 
of points with the lowest degree polynomial, commensurate with a good 
fit of the data, is required to produce the smallest standard deviation. 

The standard deviations shown are independent of the data sampling 
rate, the time interval chosen, or the absolute magnitude of the observa- 
tions. The standard deviations from this method, are a function of the 
variances of the observed parameters, the number of points used, and 
the degree of the polynomial required to produce a fit to the data. 


SECTION V. CONCLUDING REMARKS 


A method foi calculating smoothing and differentiation coefficients 
has been developed. It lends itself easily to various types of data with 
different characteristics . The method is particularly applicable to 
computer use since it eliminates the necessity for storing large numbers 
of coefficients in memory. Because of the cumulative effect of round-off 
error inherent in least squares techniques, the computations involved in 
the calculation of the coefficients should be done in double precision. 



Assumes Equal Weights 
Assumes Varying Weights 




Smoothing Coefficients Assuming the 
First, Third, and Fifth Derivatives 
Constant 
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Fig. 2, First Derivative Coefficients Assuming 

the Second, Fourth, and Sixth Derivatives 
Constant 
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Number of Points 

Fig. 5. Position Standard Deviations 
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